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We study the entropy production rate in systems described by linear Langevin equations, con¬ 
taining mixed even and odd variables under time reversal. Exact formulas are derived for several 
important quantities in terms only of the means and covariances of the random variables in question. 
These include the total rate of change of the entropy, the entropy production rate, the entropy flux 
rate and the three components of the entropy production. All equations are cast in a way suitable 
for large-scale analysis of linear Langevin systems. Our results are also applied to different types of 
electrical circuits, which suitably illustrate the most relevant aspects of the problem. 


I. INTRODUCTION 

Non-equilibrium systems have been the subject of in¬ 
tensive research for several decades. This is partly moti¬ 
vated by its broad range of applications in, e.g., physics, 
chemistry and biology. However, and most importantly, 
further progress in these areas is still hampered by more 
fundamental questions. Unlike equilibrium statistical 
mechanics, which is by now a well established theoretical 
framework, in non-equilibrium statistical mechanics sev¬ 
eral questions remain unanswered. Particularly challeng¬ 
ing is the microscopic definition of entropy production. 
For, in the context of non-equilibrium thermodynamics 
[I] , it provides the pathway through which irreversibility 
is described. 

Suppose a certain system undergoes a change of state, 
from state A to state B. If done reversibly, the total 
change in the entropy S of the system is AiS = / dQ/T, 
where T is the temperature and Q is the heat poured 
into the system. Hence / dQ/T is defined as minus the 
entropy flux from the system to the environment. If the 
process is irreversible we have instead A5 > / dQ/T. 
The difference, being a positive quantity, is called the 
entropy production fp 


A5- 


dQ 

T 


«P > 0 


It is customary to divide by At and write, instead 

^ = u{t)-m ( 1 ) 

In this equation n(t) is the entropy production rate of 
the system, which is always nonnegative, and <i>(t) is the 
entropy flux rate from the system to the environment. 
For systems in a non-equilibrium steady-state (NESS) 
we have d5/dt = 0, which implies 


IIo = ‘f’o > 0 


It is only in thermodynamic equilibrium that the equality 
in this equation is expected to hold. 

Traditionally, non-equilibrium thermodynamics was 
founded on the basis of conservation equations. Nowa¬ 
days, however, it has been realised that there are several 


advantages in using stochastic processes instead. For 
instance, by comparing forward and backward experi¬ 
ments, it enables one to the relate the entropy production 
directly to the stochastic trajectories of the system Hi]. 
When describing a non-equilibrium system in terms of 
stochastic processes, much of the focus has naturally been 
on Markovian dynamics, in particular using the mas¬ 
ter equation HEIIMSI or the Fokker-Planck approach 
mu [To] , which will be the choice for the present pa¬ 
per. We also note that non-Markovian dynamics have 
also been recently investigated m- 

Several formulas for the entropy production rate have 
been derived for both representations. In all cases, how¬ 
ever, these are written in terms of integrals involving 
probability currents (cf. Sec. HI|. Thus, they are not 
easily computed in most situations. In this paper we will 
focus on linear Langevin systems; i.e., where all terms 
appearing in the stochastic differential equations are lin¬ 
ear in the independent variables. First of all, one must 
always emphasise the importance of linear systems, in 
view of the many circumstances in which they appear in 
nature. Moreover, we will show that, for such systems, it 
is possible to obtain exact formulas for the entropy pro¬ 
duction rate in terms of the means and variances of the 
independent variables. This enables one to study more 
complex situations, which are prohibitive for non-linear 
systems. In fact, with the scheme to be derived below, 
it is possible to implement extremely efficient numeri¬ 
cal procedures to study the entropy production even in 
large-scale systems. 

The entropy production gives insight into the proper¬ 
ties of systems out of equilibrium. And with the formulas 
developed in this paper, it becomes simple to compute 
the entropy production even for the most complex lin¬ 
ear systems. Moreover, these results are not restricted to 
the steady-state as in most recent papers, but also nat¬ 
urally include the time-dependence. We thus hope that 
these results are of value to deepen our understanding of 
non-equilibrium physics. 

When discussing entropy production, it is paramount 
to distinguish between variables that are even and odd 
under time reversal. With this in mind, we shall illus¬ 
trate our results by applying them to electrical circuits. 
These are excellent platforms for this type of problem, 
since they contain mixed even (charge and voltage) and 
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odd (current) variables. These studies trace back to 
the works of Landauer [12], and the discussion about 
the differences between the minimum entropy principle 
and the maximum entropy principle. They were also re¬ 
cently discussed in Ref. m using the Onsager-Machlup 
Lagrangian [14]. 

The problem and the basic underlying equations will 
be stated in Sec. jlTJ General remarks about the entropy 
production rate will be given in Sec. Ill and the deriva¬ 
tion of the formulas for linear systems will be carried out 
in Sec. |IV| Some of the lengthier calculations were post¬ 
poned to the appendix. The applications in electrical 
circuits are contained in Sec. jV] and the conclusions in 
Sec. El 

With the exception of Sec. jVj we shall try to maintain 
the following notation. Vectors are denoted by lower¬ 
case letters, such as x = (xi,..., Xn) and matrices by 
upper-case letters such as A and B. The exception will 
be random variables, such as X, which will also be in 
upper-case letters. All vectors are treated as column vec¬ 
tors, with x"^ representing the corresponding row vector. 
Scalars and scalar functions are denoted by calligraphic 
letters such as 5 or 7^ (the only exception being 11 and 
$ in Eq. 0). The gradient of V with respect to x is 
abbreviated as dV jdx. 


II. SYSTEMS DESCRIBED BY LANGEVIN 
EQUATIONS 

A. The Langevin equation 

Let X = (Ai,..., Xn) be a vector of random variables 
satisfying 

X = f{XA)+Bi{t) (2) 

In this equation f{x,t) is an arbitrary n-dimensional 
function of x and the time, t. The ^{t) are m indepen¬ 
dent standard Wiener processes and, therefore, B is an 
n X m matrix m- In this paper we shall focus mainly 
on linear systems, for which we write 

f{x,t) =-Ax+ b{t), (3) 

where A is n x n and b{t) is an arbitrary n-dimensional 
function of time. We shall also make the reasonable as¬ 
sumption that all eigenvalues of A are in the open right- 
plane, thence guaranteeing the stability of the solutions. 

The expectation of x is denoted by a; = (A), both 
notations being used interchangeably. The equation for 
the time evolution of x is obtained directly by taking the 
expectation of Eq. ([^ : 

= f{x,t) =-Ax + b{t) (4) 

Next we obtain the equation describing the time evo¬ 
lution of the second moments. The latter can be con¬ 
structed from the outer product (AA"’’), which gives a 


matrix whose (i, j)-th entry is (A^Aj)- The result - ob¬ 
tained for instance by discretising time, taking the outer 
product and then averaging - is 

= A/T + /A^ -f BB'^ (5) 

For linear systems it is more convenient to work with the 
covariance matrix: 

0=(AAT)-(A)(A)T (6) 

Note that 0 is symmetric by construction. Moreover, be¬ 
ing a covariance matrix, it is also positive definite. Using 
Eqs. Q and ([^ and assuming linearity, as in Eq. 0, we 
find that 


= -(A0 -H 0A^) -h 2D (7) 

dt 

which is a matrix differential equation giving the time 
evolution of the covariance matrix. Here D is the n x n 
diffusion tensor defined as 

D = ]^BB^ (8) 

If B has full row rank, then D is positive-definite; other¬ 
wise it is positive semi-definite. 

Eq. 0 shows an important property of linear systems 
of Langevin equations, which is seldom discussed in the 
literature: all terms involving the external forcing term, 
b{t), dropped out. This means that the variability of the 
random variables in question is not influenced by external 
forces. In other words, we could say linear systems are 
not amenable to synchronisation. 

If b{t) — b, a constant, then the system will eventually 
reach equilibrium (we are making the explicit assumption 
that A is stable). The equilibrium value of x is read 
immediately from Eq. 0: xq = A~^b. Similarly, setting 
00 = 0 in Eq. 0 we obtain the matrix equation 

A0O -f 00^"^ = 2D (9) 


This is a very important equation. It appears frequently 
in the literature of electrical engineering and control sys¬ 
tems where it goes by the name of continuous time Lya¬ 
punov equation. It is also a particular case of the broader 
class of Sylvester equations. 

It seems appropriate to stop now to briefly discuss the 
solution methods of Eq. 0. For algebraic solutions we 
can transform it into a linear system of equations as fol¬ 
lows. Let A® B denote the Kronecker product of two 
matrices A and B and define the operation vec(A) as 
that of creating a vector by stacking the columns of A. 
Then Eq. 0 can be written as 


(/ G A) -I- (A G I) vec(0o) = 2vec{D) (10) 


Given that 0 is symmetric, several equations will be 
repeated and, in the event that A is sparse, several 
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equations will be of the form 0 = 0 , thence simplify¬ 
ing somewhat the computations. On the other hand, 
this approach should never be used for numerical cal¬ 
culations. The computational complexity of Eq. (10) is 
0(n)®. However, specialised algorithms have been devel¬ 
oped which reduce this to 0{n)^, a substantial improve¬ 
ment m- 


B. The Fokker-Planck equation 


Let V{x,t) denote the probability density function 
(PDF) corresponding to the vector of random variables 
X. The Fokker-Planck equation for V{x,t) associated 
with the general Langevin equation ([^ reads 





fj{x,t)V 




dxjdxk 


DjkV 


( 11 ) 


It is also convenient to write this equation in the form of a 
continuity equation. For this let us define the probability 
current 


9 {x,t) = f{x,t)V{x,t) - D 


dV{x, t) 
dx 


( 12 ) 


C. Distinction between variables that are even and 
odd under time reversal 

In studying the entropy production, it is important to 
distinguish between odd variables, which reverse sign un¬ 
der time reversal, and even variables, which do not. Ex¬ 
amples of even variables include the position in mechani¬ 
cal systems and charges or voltages in circuits, their odd 
counterparts being velocities and currents. Following [3] 
and m let us define, for each variable Xi, a quantity Ci 
such that Ci = ±1 if aJi is even or odd respectively. More¬ 
over, let us define a diagonal matrix E = diag(ei,..., £„). 
Then, time reversal is achieved by the operation x —>■ Ex 

m- 

Let us also divide f{x,t) in Eq. ([^ into irreversible 
and reversible parts: 

fix,t) = r{x,t) + r^ix,t) (16) 

where 

t) = l [fix, t) + EfiEx, t)] = EriEx, t) 

(17) 

r''ix,t) = ^ lf(x,t) - Ef(Ex,t)] = -Er^(Ex,t) 


Eq. (11) can then be written as 


E - 

~di ~ 


(13) 


where the operation in the right-hand side denote the 
divergence of g. 

The Fokker-Planck equation for linear systems satisfies 
the very important property that it’s solution must be of 
the form of a multivariate normal distribution 1181 : 


It is convenient to separate even and odd variables by 
writing x = ixi,X 2 ), where it is agreed that xi contains 
all even variables and X 2 all odd ones (the dimensions of 
Xi and X 2 depending on the problem in question). We 
then have that 

Ex = ixi,—X2) (18) 

Let us also define 


V{x,t) 


1 

V(2^)”|0| 





All 

Ai2 

r 

1 rr^ '» 

A = 



expj 

- 2 (^“^) 0 ” 


A 21 

A 22 


(19) 


(14) 

where x and 0 are given by Eqs. Q and Q (both being, 
in general, functions of time, which has been omitted for 
clarity). Here |0| denotes the determinant. 

In the event that b{t) is a constant, the system will 
reach a steady-state whose distribution is 


where the block matrices Aij have dimensions compatible 
with those of Xi and X 2 - Then, according to Eq. we 
may write 

A = -b (20) 


«P {- ((»^ - *o)''e„-'(x - X,)} 


(15) 


where xq = A and 0o is given by Eq. §. 

Throughout this paper we will make frequent use of the 
fact that both V{xA) and dV/dx vanish at the bound¬ 
aries of the probability space, so that cross terms appear¬ 
ing when integrating by parts can always be neglected. 
While this assumption is reasonable in most systems, it 
is in fact entirely justihed for the linear problem, given 
that the PDF is described by a multivariate normal dis¬ 
tribution, as in Eq. (14|. 


where 



1 

0 

1 _ 


■ 0 

1- 

(N 

= 

, = 



(N 

(M 

0 


to 

0 


Finally, we divide the external forcing term, 6 (t) as b{t) = 
( 6 i(t), 62 (t)) with hi and 62 having the same dimensions 
as xi and X 2 - It then follows again from Eq. 0 that 

6 -= (61,0), 6 -’' = (0,62) (22) 

Explicit examples of this separation are given in Sec. |V] 
for several types of electric circuits. 
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It will also be important to distinguish the irreversible 
and reversible parts of the probability current: 


irr I ^rev 


9 = + 9 


(23) 


where 


t) = r{x, t)rix, t) - (24) 


dx 


g^^'^{x,t)=r''{x,t)V{x,t) 


(25) 


D. Conditions for equilibrium 


In the steady-state Vq = Q and thence • go = 0. 
Moreover, the probability currents goix) should be such 
that even components change sign under time reversal 
whereas odd components do not; i.e., 


go{x) = -Ego{Ex) 


Using the definitions in Eq. (23)-(|25|) we find 


go{Ex)= r^Ex) + r\Ex) VoiEx) - D 


(26) 


dVoiEx) 


dEx 


With the aid of Eq. (1T7| this may be written as 


.dTo{Ex) 


dx 


goiEx) =e[- /-"(a:) + r\x)\ VoiEx) - DE 
Whence, 

goix) + Ego{Ex) = f'^ix) Vo{x) - Vo{Ex) 
+ /"'"'(a;) [^o(a:) -b Vo{Ex) 




dx 


dx 


= 0 


If Vo{Ex) = Vo{x) (the distribution is an even function 
of the odd variables), the first term in Eq. (271 vanishes. 
Moreover, if EDE = D (which is generally true if D is 
diagonal or block-diagonal), then by comparing Eq. (27) 
with the definition (24) we conclude that 


^ r(x)V^{x) - = 0 

i.e., the irreversible portion of the current is zero in the 
steady state. This condition has already been discussed 
in the context where D is diagonal m- For the more 
general case presented here we see that the two conditions 
for this to happen are that Vo{Ex) = Vo{x) and EDE — 
D. 

Being this the case, we find from • go = 0 that 


dx 


go — 






Vo + [r^{x)v^ = o 


In most physical systems the reversible part of the force, 
/''®''(x), is divergence-less: 


dx 


r^x) = 0 


(28) 


In this case, we may use Eq. (24) to write = 
£)-i/irr(^)-p^(^) gQ g^g finally arrive at 

[r^ix)fD-^[r{x)]=0 (29) 

This is the required condition for equilibrium. It says 
that the vectors and should be orthogonal in 
a space whose metric is D~^. In the event that D is 
semi-definite, then by D~^ we mean the pseudo-inverse 
of £1. 


III. ENTROPY PRODUCTION: GENERAL 
STATEMENT 

The following calculations follow closely those of 
Ref. [3], but generalise it in two ways. First, it includes 
systems with arbitrary combinations of even and odd 
variables and second, it includes non-diagonal U’s. 

The entropy is defined as 


S = - VlogVdx 


(30) 


Differentiating with respect to time, using Eq. (13) and 
integrating by parts we find 

diS f dV , „ , f ^dV da; 


(27) Separating g as in Eq. (231 we find for the term involving 


g*'®'', after integrating by parts: 


JL r 

dx 


V dx = Q 


since we are assuming Z’’®'' is divergence-less [cf. 
Eq. (28)]. Hence, Eq. (31) becomes 


dt 


i^^TdV da; 
dx V 


9 


(32) 


Next we use Eq. ( [24| to write 
dV 


^=D-i[/‘"(a;,t)U-g-(a;,t)] 


and obtain 

— ^ /"oirrT^-l irrZ^ _ 

dt ^ ^ V 


gir'UD-i/ir'da; (33) 


The first term is a quadratic form. Since D is positive 
definite, it is always non-negative and can thence be iden¬ 
tified with the entropy production rate: 


m) = j 


(34) 
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Consequently, the entropy flux rate is found to be 

$(t) = - j D-^dx (35) 


Using a different approach, Eq. (34) was further sepa¬ 


rated in Ref. [1] into three terms. These, unlike Eq. (34), 
hold only for diagonal D. They also assume that 
a steady-state, time-independent, configuration exists. 
Usually, we will simply take this to mean that b(t) = b, 
a constant. In our present notation, the formulas are: 


ni(t) = 

n2(t) = 
n3(t) = 


dr. r{x,t) 

at Voix) 


[g^^^{Ex)fD-\g^^^iEx)] 


fdv. Voix) , 

-y 


T 'Pjx^t) 

[VoiEx)]- 


(36) 
■dx (37) 
(38) 


where Vo is given by Eq. (15) and '' is obtained from 


5 ''''' in Eq. (24) by replacing V with Vq. The first contri¬ 


bution, termed nonadiabatic, is related to the relaxation 
processes of the system and should be zero at a NESS 
(non-equilibrium steady state). On the other hand, the 
second contribution, termed adiabatic, is directly related 
to the absence of detailed balance in the system and will 
be the sole contribution to 11 when a NESS is reached. 
Both Hi and 112 have been shown [4] to obey integral 
fluctuation theorems. However, the same is not true of 
the third term, Ha. 


IV. ENTROPY PRODUCTION FOR LINEAR 
SYSTEMS 

Last section summarised a series of results, valid for 
general Langevin systems. In this section we shall spe¬ 
cialise them to linear systems, as in Eq. @ , and obtain 
formulas for all relevant quantities. The major advantage 
of considering linear systems is that all results can be ex¬ 
pressed in terms of x and 0 , thus avoiding the necessity 
of performing the several integrals involved in those ex¬ 
pressions. 


A. Rate of the change of the total entropy 


We begin with the total rate of change of the entropy. 
Substituting Eq. (14) for log V in Eq. (30) we find 



(x — x)'^0 ^(x 


x) + log(27r)"'|0| 


V dx 


The last term is simply log(27r)”|0|. To compute the first 
term we proceed as follows. Since 0 is symmetric positive 
definite, we can construct it’s square, triangular Cholesky 
factorisation 0 = QQ^. Now consider the transforma¬ 
tion X = Qz+x. It transforms (x —x)'^0“^(x —x) = z. 


Whence, we see that this transformation produces a stan¬ 
dard multivariate normal, where all variables are statis¬ 
tically independent. Hence, the first term acquires the 
form {z^z) = n. We thus obtain 


1 77 

‘5(f) = 2 log |0(f)| -f - log(27re) (39) 


Differentiating Eq. (39) with respect to time and using 


a known formula of matrix calculus yields 


dS 

dt 




(40) 


Erom Eq. (§ we have 


0-1 


dt 


0-1^0-fAI" 


-f 20-111 


The matrices A"'’ and 0 iA0 are similar, and thence 


share the same trace. Thus, Eq. (40) becomes 


^=tr(0-iD-A) 


(41) 


where 0-i is generally a function of time. This is the 
required formula. It gives the rate of change of the total 
entropy of the system, which is seen to be a function of 
only the inverse of the covariance matrix, 0-i. Note, as 
before, that S is entirely independent of b{t) (the same 
will not be true for H and $). 


In the steady-state we set 5 = 0 in Eq. (41) to find 


tr(0o Id - A) = 0 


(42) 


This relation can also be derived directly from the steady- 
state solution, Eq. by multiplying both sides by 0((i 
and then taking the trace. 


B. Entropy production rate and entropy flux rate 

We now derive formulas for H and $. The formulas for 
Hi, n 2 and Ha are derived by similar methods in the Ap¬ 
pendix. Before we proceed, let us establish a convenient 
mathematical operation which will be used extensively, 
specially in the appendix. We will frequently encounter 
quantities of the following form: 

J {Ex + u)'^{Gx + v)r{x, t) dx 

which correspond to an average over V{x,t) of a 
quadratic form; here E, G, u and v are arbitrary ma¬ 
trices and vectors. When we expand the product, there 
will be only one term that is of second order in x, which 
will have the form x'^E'^Gx. Taking the expectation of 
this term yields 


(x'^E'^Gx) = y^(f'^G)ij(xiXj) 


















6 


Next we use Eq. ^ to write {xiXj) = 0y + XiXj, which 
results in 

{x'^F'^Gx) = tr(F'^G0) + x'^F'^Gx 

The last term is again a quadratic form and may thus be 
reincorporated into the original product. We thus arrive 
at the following relation: 

f {Fx + u)'^{Gx + v)V{x, t) da; = tr(F"'"G0) (43) 


We can also use the same approach to derive formu¬ 
las for the three contributions to the entropy produc¬ 
tion rate, defined in Eqs. ([36|)-(|M|). These calculations, 


however, are somewhat lengthier. Thus, we will simply 
state the results here and postpone the details to the Ap¬ 
pendix. We emphasise, once again, that these results are 
valid only for diagonal D and constant b. 

First, the result for ni(t) is: 




+ {Fx + M)"'’(Ga; -I- v) 


-f (a: - xo)'^0o ^£>00 ^(a; - xo) (49) 


That is, whenever we average a quadratic form, there will 
be a trace term containing 0 and the original term inside 
the integral, with x replaced by x. 

With this result, it is now straightforward to compute 
the entropy production rate in Eq. (341. From Eq. (14) 
we have 


dV 

dx 


= —0 ^{x — x)V{x,t) 


(44) 


Using this in Eq. (24) we find 

= (-A‘"a; -f b"AV - 
^ ' dx 

= {DQ-^ - + - DQ 

= {Fx + u)V 


-^x 


V (45) 


where we have defined F = DQ~^ — A”'' and u = — 

DQ~^x. By applying the method described in Eq. (43) 
we obtain 

n(t) = /(rx + „rD->(Fx + ,.)i><ix 


= tr(F^£)-iF0) -f (Fx -b ufD-\Fx + u) 

Using that Fx+u = —A'^'^'x and expanding the matrix 

product inside the trace we finally find that 

n(t) = ti{De-^ - A‘") -b tr(A‘"'^F»-i A'‘'‘'0 - A^") 

-b (A‘‘'‘'x - (A'^x - 6‘") (46) 


which is the required result. 

We can identify the first term in Eq. ( [46| as being 
simply diS/dt in Eq. (41). Hence, from Eq. 0 we im¬ 
mediately find 


.T 


$(t) = tr(A'"'^F»-iA‘‘'‘'0 - A^") 

-b (A^'-'x - 5'‘'‘')'^F»-i (A‘"x - &‘") (47) 


This result can also be easily derived from Eq. (35) using 
the same method. 


In the steady-state, making use of Eq. ( |42[ ) we find 
Ho = $0 = tr(A‘"'^F-iA‘"'0o - A'") 

-b (A'"xo - y''‘')'^F-^(A'"xo - y") (48) 


The nature of Hi, as being related to the relaxation of 
the system, becomes quite visible from the structure of 
this formula. Next, we obtain for II 2 : 

n2{t) = tr(A‘''"'^i:)-^A”0) - tr(A^F0((iF0) 

-b (A‘"x - b^'^fD-^A^'^'^x - 6'") (50) 

— (Ax — b)"^ {Ex — xq) 

Finally, the result for Hs is: 


n3(t) = tT{A^Eeo^E0 - A) - tr(A'^0o i0 - A) 


-6)^F0((i(Fx-xo) 

(51) 

xo)'^0o ^F0o ^(x - xo) 

(52) 


V. APPLICATION TO ELECTRICAL CIRCUITS 

Henceforth we will soften our previous notation of vec¬ 
tors and matrices, and use the usual nomenclature of 
electrical circuits. We shall consider electrical circuits 
connected to different heat baths. The coupling constant 
is, in this case, the resistance F. The fluctuations will be 
assumed to correspond to white noise with spectral den¬ 
sity given by the Jonhson-Nyquist formula V‘2RT, where 
T is the temperature of the bath. 


A. RL circuit in series 


We begin by considering a simple, yet very instructive, 
example of a resistor R and an inductor L in series with 
a battery providing a constant emf £. The independent 
variable is the current / through the resistor, which is odd 
under time reversal. The equation for the time evolution 
of I is obtained from Kirchhoff’s voltage law: 


dJ R^ £ 2RT ■ 


(53) 


Making reference to the notation of Sec. HA (all ma¬ 
trices are now 1 x 1), we have A = R/L, b = SjE^ 
B = y/mrJlA and D = {1/2)BB'^ = RT/L"^. For 
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simplicity, we will assume /(t = 0) =0. The expectation 
of / as a function of time is obtained by solving Eq. Q: 

= (54) 


The steady-state current is clearly seen to be Iq = £R. 
The covariance “matrix” is 0 = (/^) — P and satisfies 
the differential equation [cf. Eq 0 ] 


d0 

dt 



2RT 


(55) 


whose solution is 


0(t) = ^(i_e-2^‘/^) 

Lj 


(56) 


The current is an odd variable under time reversal. 


Thence, we have from Eq. (21) that = A = R/L and, 


from Eq. (22), = 0. With this in mind, the entropy 

production rate is readily computed from Eq. 


c2 n -2RtlL 

= + (57) 


If we take the limit t —>■ oo we obtain for the NESS 
entropy production rate: 

c2 D j2 

no = $0 = ^ (58) 

This formula shows that, in the NESS, there is a con¬ 
stant production of entropy due to the dissipation in the 
resistor. 

The formula for the total rate of change of the entropy 
is 

dS R 1 
“ L - 1 


The entropy flux rate is then simply $ = 11 — diS/dt. 
These quantities are illustrated in Fig. [^a) for arbitrary 
values of the parameters. 

If we had, instead, studied an RC circuit then the inde¬ 
pendent variable would be the voltage through the resis¬ 
tor, which is even under time reversal. In this case, the 
formulas would be quite similar, except that now, the 
emf would be a part of 6''^''. The resulting expression for 
the entropy production would now go to zero as t —)■ oo 
since, in an RC circuit, the current (which is responsible 
for the dissipation) goes to zero as t —)■ oo. 

Continuing further, we may now compute formulas for 
the three parts of the entropy production rate, Eqs. (49)- 

d^: 


T. . 5 -2Rt/L R 

+ L - 1 


n2(<) 


n3(0 ^ 


C2 

.2 — e-^R^ 
RT 



t 



FIG. 1: Entropy production as a function of time for an RL 
circuit with £ = 2Y,R=1Q, L — lYL and fcsT = 1/2 J. (a) 
diS/ dt (blue, dotted), 4>(t) (red, dashed) and n(t) (black); the 
dotted line indicate the NESS value IIo = 112 = £^/RT. (b) 
The different contributions to the entropy production rate; 
Hi (blue, dotted), IIs (red, dashed) and II (black). Again, 112 
is given by the dotted horizontal line. 


These formulas are physically very rich. Note that 112, 
which is exactly the contribution related to the absence of 
detailed balance, is simply the steady-state entropy pro¬ 
duction rate Ho in Eq. (58). Graphs for these quantities 
are illustrated in Fig. [ifbb 


B. Mixed RC and RL circuits 

Let us now turn to the circuit denoted in Fig.[^ which 
was also studied in Ref. [I3]. We now have, as inde¬ 
pendent variables, the voltage U through resistor Ri and 
the current I through the resistor R 2 ; i.e., we have mixed 
even and odd variables. Using Kirchhoff’s voltage law we 
find the equations 

/ U , / 2Ti ^ 

~C RiC^\RiC'^^^ 


I = 


£-U -R 2 I 


2R2T2 

L2 


6 


L 


(59) 

(60) 





























3.0 


FIG. 2: Scheme of the circuit studied in Sec. IyB Each resis¬ 
tor is connected to a heat bath at a different temperature. 


In our usual matrix notation we have from Eq. @ 
= 


'l/CRi 

0 

A rev _ 

■ 0 

-lie 

0 

R 2 /L 

I ^ — 

l/L 

0 


and from Eq. (22) 


6"’' = 0, 


= b = 


0 

E/L 


The diffusion matrix, Eq. Q, is 

'Ti/RiC^ 0 


D = 


0 R2T2/L^ 


The formulas for the time-dependence of the entropy 
production rates are now somewhat cumbersome. Thus, 
we will illustrate their time dependence numerically and 
provide formulas only for the steady-state quantities. 
The equilibrium values of U and I are 


Uo = — — — S, lo = - ^ - S 

Ri + i?2 Ri + R 2 

The steady-state values of the covariance matrix are ob¬ 
tained by solving Eq. © (the notation Var and Gov 
meaning variance and covariance respectively): 


Var(C/) 

Var(J) 

Cov(C/, I) 
a 


L(i?i -h R2)Ti + CRiR2{R2Ti + R 1 T 2 ) 

LiR^Ti + R2T2) + CRMRi + R2)T2 


a 


i?ii?2(72 — 



[{Ri + R2){L + CRiR2)]-^ 


From these results we may now compute the steady- 
state entropy production rate from Eq. (48): 


fin — <i>n — 


C/n 


R 2 I 0 


RiR2iT2-T,y 


RiTi 


T 2 


{Ri + R2){L + CRiR2)TiT2 

( 61 ) 

The structure of this result is worth noticing. The first 
two terms are similar to those appearing in Eq. (581, 


^.0 0.5 1.0 1.5 2.0 2.5 


t 



t 


FIG. 3: Entropy production as a function of time for the cir- 
cnit in Fig. with £ = 2 V, i? = 2 fl, 1^2 = 1 fl, T = 1 H, 
C = 0.2 F, fesTi = 1 J and kBT 2 = 2 J. (a) d5/ dt (blue, 
dotted), 4>(t) (red, dashed) and n(t) (black) (b) The different 
contributions to the entropy production rate; Hi (blue, dot¬ 
ted), 112 (red, dashed) and Ha (green, dash-dotted); n(t) is 
again shown in black. 


each one corresponding to a resistor. They stem from 
the absence of detailed-balance, related to the presence 
of the batteries. In addition to them, however, there is 
now a second term related to the lack of detailed balance 
due to the presence of two heat baths. We see that it 
depends only on (Ti — T 2 )'^. It is thus zero when both 
temperatures are equal, and shows that it is irrelevant 
which temperature is the largest. 

It is worth comparing Eq. (61) with a similar result 
obtained for the same circuit in Ref. [13]. There, the 
third term was not present. This follows because, in the 
formalism of the Onsager-Machlup Lagrangian El, the 
entropy production rate is related to the extremum of the 
Lagrangian with respect to the independent variables. 
Since the last term in Eq. (61) is independent of U and 
I, it does not appear in that formalism. 


In Fig. [^a) we show the total rate of change of the 
entropy, the entropy production rate and the entropy flux 
rate as a function of time, for arbitrary choices of the 
parameters. Fig. [^b) then shows the 3 contributions to 
the entropy production rate. 
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C. Inductively coupled RL circuits 

Next, we turn to the interesting example of two induc¬ 
tively coupled RL circuits, each connected to a different 
heat bath. Let the suffixes 1 and 2 denote the quanti¬ 
ties pertaining to the two circuits and let m denote the 
mutual inductance. Then, the corresponding dynamical 
equations are 


Liii ~\- m /2 — ~RiIi Si -\- \/ 2i?iTi^i 


mil L2/2 — —R2I2 S2 \/ 2R2/2C1 


Let us defined the matrix 


M = 


Li m 
m L 2 


Then, in the notation of Eq. (© we have 


and 


A = M-i 


Ri 

0 


0 

i?2 


D = M-i 


RiTi 

0 


0 

R 2 T 2 


M-i 


In this case, we see that the diffusion matrix D is not di¬ 


agonal, so formulas (49)-(511 are note applicable. We will 


thus restrict our discussion to the steady-state expres¬ 
sion for the entropy production rate. The steady-state 
currents are simply 


- a ’ 


^^°-R2 


The steady-state covariance matrix is computed from 
Eq. It reads 


00 = 


Ti 

raR\iT2—T\) 

L2R\-\-LiR2 


mR2{Ti — T2) 
Z/2i?l+ivli?2 

T 2 


M 


-1 


On noting that both variables are odd under time re¬ 
versal, we obtain from Eq. (48): 


Rn = 


£2 

RiTi 




£2 

R 2 T 2 

m?RiR2 


(Ti - T2f 


{L1L2 - m 2 )(L 2 Ri + L1R2) T1T2 


(62) 


(63) 


Again, we arrive at a structure compatible with the two 
sources of disorder: the first two terms come from the 
batteries and the last from the presence of two heat baths. 
As expected, the last term goes to zero when m —>■ 0 since 
the mutual inductance is the sole mechanism of coupling 
in the system. 


Finally, it is also illustrative to consider three induc¬ 
tively coupled RL circuits. For simplicity, we will make 
the assumption that all mutual inductances and self¬ 
inductances are the same, being m and L respectively. 
The result is then 


Rn = 


£2 


£2 

^2 


-k 


£2 


m 


2 r 


RiTi R2T2 R3T3 W - 


aiTi{T2-T^f 


+ Ot2T2(Ti — + Oi3T3{Ti 


T 2 ) 


2 1 

J TIT 2 TS 


where 


W= (L-m)(L + 2m) 


2m^RiR2R3 


-h L(L -|- m)(i?i -|- /? 2)(/?2 + R3){Ri + R 3 ) 


and 


ai = R2R3 


2mRi -|- L(i?i -|- R2){R2 T R 3 ) 


with similar expressions for a 2 and 03 . Again, the results 
depend only on the temperature differences, as expected. 


VI. CONCLUSIONS 

In conclusion, we have studied the entropy production 
rate in systems of linear Langevin equations. Linearity 
and it’s consequences enabled us to compute formulas 
for (i) the total rate of change of the entropy, (ii) the 
entropy production rate per se, (iii) the entropy flux rate 
and (iv) the three contributions to the entropy produc¬ 
tion stemming from different physical sources. All these 
formulas were expressed in terms of the mean and covari¬ 
ance matrix of the random variables in questions. This 
makes their implementation in large-scale systems quite 
easy. Our results were applied to electrical circuits of 
various types. For instance, we have shown that two cir¬ 
cuits which are coupled only via their mutual inductance 
have a steady-state entropy production rate related to 
the difference in temperature between the two circuits. 
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Appendix A: The three parts of the entropy 
production rate 


In this section we describe the steps to obtain formu¬ 


las (49)-(5I) from Eqs. (36l-(38). 
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1. Equation for ni(t) 


We begin with Hi in Eq. (36), which can be written as 
ni(t) = — + El (Al) 

where d5/ dt is given by Eq. (41) and 

^i{t) = J ^\ogVo{x)dx (A 2 ) 


Using the FP Eq. (13) and integrating by parts we find 

rYdVo{x) dx 


ri= / 5^ 


dx Vq{x) 


Similarly to Eq. (44) we have d'Po{x)/dx = —0g — 
xo)'Po{x). Using also Eq. ( [isj ), but with g instead of 5 *’'''; 
i.e. with F = DQ~^ — A and u = b — DQ~^x we find 

Ti = — J[Fx + u)"^0g ^(a; — xq)P{x, t) dx 


Using the method of Eq. (43) we obtain 

El = — tr(F"'’0o0) — {Fx + u)'^0o(a; — xq) 

This can be simplified to read 
Ei(t) =tr(A^0oi0-A) + (Ax-6)'^0oi(x-xo) (A3) 


The last term in Eq. (A3) can also be modified as fol¬ 


lows. Multiplying both sides of Eq. (^9| by 0o we find 


0n'A +A^0nl = 20n'£l0, 


— 1 TAO—1 


(A4) 


Now let y be an arbitrary vector. Noting that y'^My = 
y"^Al'^y we find 

2/T0-iyly + y^AT0-ij; = 2y'^A'^e^^y 

= 22/T0-i740g-iy 

Using this and recalling that b = Axq we may write 
{Ax — b)'^QQ^{x — Xq) = {x — Xo)"''A"'-Oq^{x — Xg) 

= {x- Xo)'^0o ^-D0o - Xg) 


Using this result in Eq . (|A3| ) and substituting in Eq. (Al) 
we finally obtain Eq. (49). 


2. Equation for n 3 (t) 


as 


Let us next compute Ug in Eq. (38). It can be written 
n 3 (t) =E 2 (t)-Ei(t) (A5) 


where E 1 {t) is given by Eq. (A2) or (A3) and 

^2{t)= J ^ogVg{Ex) dx 


= J 9 {x,t) 


rj<dVg{Ex) da; 
dx Vo{Ex) 


(A6) 


We now have 

dPo{Ex) 

dx 


= —EQq ^{Ex — Xg)Vg{Ex) 


Using again the definitions F = DQ ^ — A and u = 
b — DQ~^x we find 

E 2 = — y {Fx + EQq^ {Ex — xo)P{x, t) dx 


Using the method of Eq. (43) we obtain 

E 2 = - tr(F^E0oE6») - {Fx + ufEeo{Ex - Xg) 
The first term reads 

- tr(F^A0oA6») = tr(A'^E0-iE0 - Q-^DEQ-^Ee) 

For the last term we may use the cyclic property of the 
trace to write it as tr(EZlE0)j'^). However, since D is 
diagonal, we have that EDE = D. Whence, the last 
term is simply tr(Z10g = tr(A), according to Eq. (42). 
Collecting our results we finally conclude that 


E 2 (t) = tr{A^EQQ^Ee - A) 

+ {Ax — b)'^ EQq^ {Ex — xg) (A7) 


Using this and Eq. (A3) in Eq. (|A5|) we finally obtain 
Eq. (P). 


3. Equation for Il 2 (t) 


Finally, we turn to II 2 in Eq. (37). We begin by writing 
= [{DQ^^E - A'^'’^E)x + y" - DQQ^xg]Pg{Ex) 
= {Ex + u)Vg{Ex) (A 8 ) 

We then have 

n 2 = J {Fx + u)'^ D~^{Fx + u)V{x,t) dx 

= tT{F'^D-^Fe) + {Fx + ufD-\Fx + u){A9) 

Let us first simplify the trace term: 


tr(E^i7-iF0) = tr EQQ^{Deo^ - 2A^'^'^)EQ 


+ tr(£;A”'‘' D-M"'''£;0) 


(AlO) 
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The first term can be simplified as follows. First, we note Finally, the last term in Eq. (AlO) can be written as 


the following relation stemming from Eqs. (19)-(21): 


= ^(A + EAE) 


(All) 


Using this in the first term of Eq. (AlO) we find 

EBo^iDO^^ -2A"'^)Ee 


tr 


= tr 


EQg^DBQ^ - A)Ee 


- tr(£;0o ^EA0) 


Similarly to the first term in Eq. (A7), the last term in 
this equation can be written as tr(A^i?0(C^i?0). More¬ 
over, the first term is zero, which may be shown by sub¬ 
stituting 

^©0' = +00^^00') 


tr(A'''“' D ^A‘''’^0). This is a direct consequence of the 
structure of A*''*' in Eq. (21) and the fact that we are as¬ 


suming D to be diagonal. In fact, for a non-diagonal 
D this simplification would not occur and this term 
would not correctly match it’s counterpart appearing in 
Eq. (14^. Thus, we conclude that 


tr(E^£)-^F0) = tr(A”'‘' £>-^‘"0) - tr(A^£;0o ^£0) 


T ZT'Cl —Ij 

(A12) 


For the second term in Eq. (A9) we now have 


Ex + u = DQq {Ex — Xq) -|- 6''’'^ — A'^^'^Ex 


Expanding the quadratic form, using Eq. (All) and sim¬ 


plifying finally yields the required corresponding term in 
Eq. (1^. 
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